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Abstract 

According to the Smoluchowski-Kramers approximation, the solution 
of the equation /^gf = — + J^{qt)Wt,qQ — q,q^ — p converges 

to the solution of the equation qt = b{qt) + 'S{qt)Wt,qo = g as /i — 0. 
We consider here a similar result for the Langevin process with elastic 
reflection on the boundary. 
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1 Introduction 

The well-known Smoluchowski-Kramers approximation ([5], [5]) implies that the 
solution of the stochastic differential equation (S.D.E.) 

= - + S(gnW^t (1) 

q^ = peW 

converges in probability as /i — ^ to the solution of the following S.D.E. : 

qt - b{qt) + ^{qt)Wt (2) 

where b = &r) (the transpose of (5i, with bj : W R, j = 1, ..,r, 

Tj = J with aij :W -^M.,i,j = l,..,r have bounded first derivatives and 
Wt = {Wf , ...,W[) is the standard r-dimensional Wiener process. In other 
words, one can prove that for any S,T > and q,p E W (see, for example, 
Lemma 1 in [6]), 

limP( max Igf - qA > S) = 0. (3) 

Ij.i0 0<t<T ^ I ' ^ ' 

Equation ([1]) describes the motion of a particle of mass /i in a force field b{q) + 
Ti{q)Wt with a friction proportional to velocity. The Smoluchowski-Kramers 
approximation justifies the use of equation (|2]) to describe the motion of a small 
particle. 

It is easy to see now that ([1]) can be equivalently written as: 

• u u 

It Pt 

np^t = b(q>;)-pn^iqnwt (4) 

= q^=peR^. 

Let us define M+ = {q^ G M : > 0} and let the configuration space be 
D = X R''^^. In this paper we examine the behavior of the process with 
elastic reflection on the boundary dD x R'' = x K'"^^) x K*" of the phase 

space DxW that is governed by i.e. of the Langevin process with reflection, 
as ^ when S is the unit matrix. We will show that the first component 
(the q component) of the Langevin process with reflection at q^ — 0, that is 
governed by equation (jj]) , converges in distribution to the diffusion process with 
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reflection on dD that is governed by The method is based on properties of 
the Skorohod reflection problem and in techniques developed in [2] and in [3]. 
In section 2 we define the Langevin process with reflection for general diffusion 
matrx E with inputs that have bounded first derivatives, in section 3 we describe 
the Skorohod reflection problem and in section 4 we consider the limit — > 
when the diffusion matrix is the unit matrix. We note here that the limit when 
/Li — >■ for a general diffusion matrix as above can be examined similarly. 

2 Langevin process with reflection and prelimi- 
nary results 

We begin with the construction of the Langevin process (q^ip^) in D x W 
with elastic reflection on the boundary. Let b = {bi,...,br) with bj : D ^ 
R,j = and E = [cTij] with aij : Z) — R, i, = l,-.,?" have bounded first 

derivatives and E be non-degenerate. Let {q,p) G DxW be the initial point (we 
assume that (q^)"^ + (p^)^ 0). Then (q^-jp^) is the right-continuous Markov 
process in _D x M'' defined as follows. Consider the following system of S.D.E.'s: 

Qt = Pt 



hpI-^ = -p'^'^ + bM) + T.''^M)W^ (5) 

lo = q , Po =p , 1 = 1, 



We define (q^-jp^) to be the solution to ([5]) for t G [0, t^), where = inf{t > 
: (?^^ = 0}. Then define (g^rf) for t e [t'^'^t^), where = ini{t > rf : 
It — 0}: to be the solution of ([5]) with initial conditions 

(q^amP^m) = (0, linigt linig['^;- limpf'^, \impf linipi'''). 

1 1 ttrf tt-rf ttrf ttrf ttrf 

If < rf < < ... < and {q'^;p^) for t G [Oi'^'fe ) are already defined, then 
define {q^;p^) for t £ ['''fe : ''"fc+i) as solution of ([5]) with initial conditions 

(g^MlP^^) = (0, lini gj^'^, lini ql'''; - \impl''', lini p^''', limpj''') 
" " <t< «t< tt< «t< tt< 

(see Figure I for an illustration). 

This construction defines the process {q^;p^) in D x R"" for all t > 0. This 
follows from Theorem 2.4, which states that the process that we constructed 
above does not have infinitely many jumps in any finite time interval [0,T]. 
Therefore we have the following definition: 

Definition 2.1. We call the above recursively constructed process, the 
Langevin process with elastic reflection on the boundary dD x R"". This pro- 
cess has jumps on dD x W and is continuous inside DxW. 



3 



K. Spiliopoulos 



Langevin equation with Reflection 



We will refer to the Langevin process with reflection as l.p.j:.{qf;p^). More- 
over we will denote by {qt'^^Wt'^) the trajectories of {q^]p^) with initial po- 
sition {q,p). For easy of notation we also define —x = {—x^,x'^,...,x'^) and 
\x\ = {\x^\,x^,...,x'') for X e W. 

Below we see an illustration of the construction above in the {q^ ~P^) phase 
space. 



1 

P 




Figure 1: Illustration of the Langevin process with reflection in the {q^ — p^) 
phase space 



Let us give now another construction of the Langevin process with reflection. 
Consider the following S.D.E. in R^r-; 

•l.U l.U 

Qt = Pt 

r 

nl^^ = -p,i'^-|-sgn(g^'')6i(|gf|)-K^sgn(g^'')ay(|gn)W^/ 

l.U 1 l,u 1 

% = Q ,Po =P ' 

qr = pI'" (6) 

/xp^ = -pi'^+b,iK\)+j2^vi\<i^m' 

Qo = 9,Po --P'« = 2,...,r, 

where sgn(x) takes two values, 1 if a; > and -1 if x < 0. 

Lemma 2.2. Equation ^ has a weak solution which is unique in the sense 
of probability law. 
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Proof. The existence follows from the Girsanov's Theorem on the absolute 
continuous change of measures in the space of trajectories (b and S are assumed 
bounded) and the fact that ^ with b = has a weak solution. The uniqueness 
follows from Proposition 5.3.10 of U]. 

□ 

Using the processes and {q^'^'^;p^' we can give another con- 

struction of the Langevin process with reflection, as follows. Assume that > 
and > 0, The graphs of p]'^'^ and p]'^'~^ will be exactly symmetric with re- 
spect to zero. The same will be true also for the graphs of '^'"^ and of q]'^'~'' ■ 
Let Tq = 0, = inf{i > t^_^ : q]''^''' = 0} and {q^;p'^) be a stochastic process, 
which is defined as follows: 

{q^;p^) = {qr';prni0TT,^,^,<t<r,^^-„k = 0,1,2,... (7) 

Process (qf is a process with reflection and it can be seen that 
which is the same as {\ql'''\, qf'^ , ■■■ , ^jg^ •''|, • • • , and \.p.T.{q'^;p'^) 
coincide. 

In the figures below we give an illustration of the construction of {ql''^;p]'^). 
The first figure illustrates with thick continuous and dotted lines q]'^ versus t. 
The continuous line is q]'^''' versus t and the dotted is versus t. The 

second figure illustrates with thick continuous and dotted lines p]'^ versus t. 
The continuous line is pj'^'^ versus t and the dotted is versus t. 
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Figure 2: Illustration of the process with reflection 



Lemma 2.3. Let T > 0. The Markov process (qf^p^) starting at a point 
{q,p) different from the origin O — (0, 0; 0, 0), that satisfies system 
does not reach the origin in finite time T, i.e. 

P{3t<Ts.t. (gf;pr) = O) = 0. 



Proof. We easily see that it is actually enough to consider only {ql'^;p]'^). 
Let i5 <C 1 be a small number. Define the rectangle A = {{q,p) G R x R : \q\ < 
^Ap\ — f} suppose that the trajectory starts from some point outside 
the rectangle A, say from (g,0) e \ A. Let also xa{x) denote the indicator 
function of the set A. Then XAiql,pl)ds is the expected value of the 

time , during time [0, T], that the process {qj^pD with initial point {q, 0) spends 
inside the rectangle A. If & = and E is a matrix with constant entries, {ql,pl) 
is a Gaussian process. One can write down its density explicitly (see equation 
([S])), which we denote by p{-), and obtain the bound 

E^'^°^ [ XAiqlpDds^ [ [ pis,iq,0),y)dsdy<AiT,q)S'' (8) 

Jo J A Jo 

where A(T, q) is a constant that depends on T and q. The general case can 
be reduced to the case with & = and E constant by an absolutely continuous 
change of measures in the space of trajectories and by a random time change. 

We will establish now a lower bound for the quantity XAiql,pl)ds 
under the assumption that the process {q\''^ ,p\''^) will reach (0,0) before time 
T with positive probability. This will lead to a contradiction. 

Again by Girsanov's theorem on the absolute continuity of measures in the 
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space of trajectories it is enough to consider the solution of the following S.D.E: 

pI 

ij2<^iM)W, (9) 

wheTeWl=J*sgniqi'^^)dWi. 

By the self similarity properties of the Wiener process one can find a Wiener 

process W^'* such that J* i X^j-i '^ijiQtW't = W^e(t*)' '^^'^^'^ ^(0 la ■^0'iii<ls)ds 

and an = X]j fc=i crijaik- So /p ^ X]j=i '^'Ljilt)^t can be obtained from W^'* 
via a random time change. 

By the law of iterated logarithm we get that for all k e [0, 1] there exists a 
to{k) small enough, such that 

P(t5+fe < \ wl^* \ < t^-^ for t e [O,to(fc)]) >l-k. 

Observe that if t G [0,to(A;)] then ^(t) e [0, cto(fc)], where c = ^ sup^gR |Q;ii(a;)|. 

Define also tg{k) — min{to(fc), ^^^}. Then with probability very close to 1, 
as A: -J> 0, and for ah t e [O,to(fc)] it must hold that \p]'^\ < cit^"'' and 
ql'^ — f^pl''^ds < cis^~'^ds < 2cit^~^ , for a constant ci. 

Let r be the first time, after the time that the Markov process reached the 
origin, that it exits from the rectangle A, i.e. r = inf{t > : {q},pl) G \ A}. 
Then it follows that 

E^'^'"^ rXA{qlpl)ds > E{r} X P{3t < T s.t. {ql'^;pln - (0,0)) (10) 
Jo 

Define = inf{i > : \ql'^\ > f-} and t,, = M{t > : > §}. By 

the above bounds for and p]'^ we get that Tq > CqS^ and Tp > CpS"^, where 
Cq, Cp are some constants independent of S. So the trajectory exits the rectangle 
faster in the direction of p than in the direction of q and the exit time is of order 
6'^. Therefore, by this and by ([8]), we have that 

B6^ < r XA{qlpl)ds < A6\ (11) 

Jo 

which cannot hold for constants A and B and small enough 6. So we have a 
contradiction and hence it is true that P{3t < T s.t. {q\'^\p\^) — (0,0)) — 0. 

□ 

Theorem 2.4. We have the following two statements: 



ql = 
p\ = 
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(i). Let T > 0. The Markov process l.p.r.[q'l ;p^) (with arbitrary h) does not 
reach the origin 0= (0, 0; 0, 0) infinite time T , namely 

P{3t < T s.t. l.p.r.{q'^;pt) = O) = 0. 

(ii). The sequence of Markov times {t^} converges to +oo as k ^ +oo, i.e. 

P{ lim = +oo) = 1 

Proof. The Langevin process with reflection, Lp.r.(q(';pj'), coincides at any 
time t either with (qj'''^; p^''^) or with (q^'^'^ip'^'^^). Therefore we have that: 

P(3t<T si. Lp.r.(gf;pn = 0) < P{3t < T s.t. {qr^P^) = O) 

+ Pi3t<Ts.t.{qr';prn^o). 

Hence Lemma 2.3 imphes that 

Pi3t<Ts.t. Lp.r.((z^';pn = O)=0. 

Part (ii) is an easy consequence of part (i). It is easy to see that {r^} is 
an unbounded, strictly increasing sequence of Markov times. Indeed, if on the 
contrary we assume that there exists a N such that r^' < N for all k with 
positive probability, then the trajectories of l.p.r.(g^;p^) will have limit points. 
The only possible limit point however is the origin (0, 0; 0, 0). But by part 
(i) the probability that within any time T the trajectory will reach the origin 
is 0. So {t^} is an unbounded strictly increasing sequence of Markov times. 
Therefore we have that P(linifc^+oo — +oo) — 1. 

□ 

Therefore the Langevin process with reflection has only finitely many jumps 
in any time interval [0,T] with probability 1. Hence our definition for the 
Langevin process with reflection is correct. 

3 The Skorohod reflection problem 

The convergence of the Langevin process with reflection that will be presented 
in section 4 relies on results about solutions of the Skorohod reflection problem, 
proven in [3] and [10] . 

Let us first recafl that D = R+ x W-\ dD = 9R+ x M'-i and let N{q) be 
the set of inward normals at g e dD. Denote also by D(M+,Z)) the space of 
cadldg (right continuous with left limits) functions with values in £>, endowed 
with the Skorohod topology and by B.V.(R+, D) the set of cadldg functions with 
bounded variation and values in D. 
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Definition 3.1. Let w be a function in D(R+,R'") such that w{0) G D. We 
say that the pair {q,(j)) with q 6 B(R+,I?), (f) G B.V.(M+,M'') is a solution to 
the Skorohod problem for (D, N, w) if 

qt ^wt+ (pt 

4>t= I v{s)d\(j)\s,v{s) € N{qs),d\(j)\~ a.e. 
JQ 

d\cb\{t : qt e D) ^ 0, 

where \(/)\ denotes the total variation of (p and is called the local time of the 
solution. 

The following theorem characterizes the continuity properties of solutions of 
the Skorohod reflection problem. 

Theorem 3.2. Let W be a compact subset o/ D(]R+, R*") in the Skorohod 
topology such that w{0) € D for every w & W . Moreover let Q be the set of 
{q,(j), \(l)\,w) G ]D)(R+,i:>) X B.V.(R+,R'') x B.V.(R+,R+) x D(R+,R'') such that 
(q, (f) is the solution to the Skorohod problem for {D, N, w) for some w £ W 
and q is continuous. The set D is convex and so Q is a relatively compact subset 
o/ D(R+, R"^""^^) in the Skorohod topology and for every accumulation point of 
{q,(l), \(j)\,w) in Q we have that {q,(l)) is a solution to the Skorohod problem for 
iD,N,w). 

Proof. This is a special case of theorem 3.2 in [2]. 

□ 



4 Convergence of the Langevin process with re- 
flection 

In this section we consider the limit of l.p.r.(gf ) as /i ^> when the diffusion 
matrix is the unit matrix. Below we will assume that t < T, where T ia s 
positive real number. 

Consider the stochastic process in D x M'', which satisfies the fol- 

lowing system of S.D.E.'s: 



Pipt = -pt + b{q'i) + Wt + u{q'i)-i>^ (12) 

where = = (p^^--- = {W^,---,Wn\ 

v{q) denotes the unit inward normal to I? at g G dD, b{q) = {bi{q), ...,br{q)) 
and ^I'^ = fJ-J2s<ti~'^Ps-''^{Qs))'XdD{qs)- It is easy to see that (fT2|) is pathwise 
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equivalent to the Langevin process with reflection in £) x R'' of Definition 2.1. 

and so it admits a unique weak solution. 

We will follow the method introduced in 2,. The main idea is to represent 
as the first component of a solution to the Skorohod problem for {D, N, i/'' + 

X^), where H'^ + X'' is a semimartingale. The family {H'^ + X^^} turns out 

to be tight and this enables us to use Theorem 3.2 to conclude that the family 

{q'^} is tight as well. 

We can suppose that there is a unique underlying complete probability space 
F, P). Let F denote the the cr— algebra of F of sets with P— measure or 1 

and define the filtration 

Lemma 4.1. For every fi the pair of stochastic processes (q^ , where 

$r= rK€)d*r (13) 

Jo 

is an almost surely solution to the Skorohod reflection problem for {D, N, H^^ + 
Xf^), where 

= / b{q':)ds + Wt (14) 

Proof. Consider the integral form of ([T2|) . Taking into account that Pgds = 
q^ — qo and solving for q^ we see that: 

q'; = Ht + xt + 'f^ 

Then (g'^, $'^) verifies Definition 3.1 with probability 1. 

□ 

Lemma 4.2. For every T > we have that lim^^o E[swpf^j^ l/^Pt'l^] = 0. 

Proof. Assume first that 6 = 0. Consider equations (fT2|) and apply the Ito 
formula for semimartingales to the function f{q,p) — |pp for every pair of times 
s, t such that < s < t < T. Doing that we get 

= \p^\'-- fK\'du+- fp'i-dW^ + \r{t-s) (15) 

It is interesting to observe that the local time does not appear above. 
This comes from the fact that under elastic reflection jp^p = |pf'_P for every 
t > 0. 
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Consider now a constant c > and functions x,g € B([0, T], R) with g{0) — 
such that: 

xt < Xs — c / Xudu + gt — gs, < s < t < T (16) 

J s 

Then one can easily see that 

Xt < e~^*(xo + gt) + c f e-^(*-")(5t - gu)du, 0<t<T (17) 

"'0 

By taking expected value to and applying (ITTl) with c ^ gt — -^rt 
and Xt = \Pt\ , we get 

E\p'^? < e~M*(|p|2 + i_rt) + A f e-i('-^\{t~u)du 

M M JO 

= e-"'\p\' + ^i^-^e-f) (18) 

This implies the statement of the Lemma for 6 = 0. The general case can be 
reduced to the case with 6 = by an absolutely continuous change of measures 
in the space of trajectories. 

□ 

The following two theorems are restatements of theorems 3.8.6 and 3.10.2 
respectively of |4|. 

Theorem 4.3. Let {Y^} be a family of processes with sample paths in 
IIJ(K_(-, I?). Assuming that for every e > and rational t > there exist a 
compact set T{e,t) C D such that liminf„ P(F"(t) e r(e,t)) > 1 — e, then the 
following are equivalent 

(i). is relatively compact. 

(a). For each T > 0, there exists /3 > and a family of nonnegative random 
variables {'y"{S),0 < S < 1} satisfying 

E{\Y-{t + u)- Y-{t)f IFD < EinSWl^), 

for t G [0, T] and u G [0, 5\ and in addition lim5_j.o limsup„ £^(7" ((5)) — 0. 

Theorem 4.4. Let {F"} and Y be processes with sample paths in D(M-|_, D) 
such that Yn converges in distribution to Y . Then Y is almost surely continuous 
if and only if e-"[supo<4<„ \Y"{t) - Y"{t-)\ A l]du ^ 0. 

The following lemma shows that the family {i?^ + X^} is tight in the Sko- 
rohod topology. 
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Lemma 4.5. The family {H^ + X^} defined in is relatively compact 
and all of its accumulation points are continuous. 

Proof. It is easily seen that {^''} is relatively compact and that all of its 
accumulation points are continuous. 

Now Lemma 4.2 suggests that: 

lim£;[sup|i?fp] < c (19) 
limi;[ sup \H'^ - Hl'W < ci5, (20) 

A'^O \t-s\<S 

where c, ci are positive constants independent of ^. 
Chebychev's inequality and (|19l) imply that 

liminf P(|iJi/"(i)| < A) > 1 - ^. 

Therefore by this and (PU)) . Theorem 4.3. gives us that {H^^} is relatively 
compact. Lastly ((20|) and Theorem 4.4 implies that all its accumulation points 
are continuous. 

□ 

Theorem 4.6. The family {(g^, 5'^, iJ^, X^)} is relatively compact in 
ID)(K+,M4''+1). 

Proof. It follows from Lemma 4.5 and Theorem 3.2. 

□ 

Now that tightness has been established we will proceed with the identifi- 
cation of the stochastic difi^erential equation with reflection that describes the 
behavior of as ^ ^ 0. 

Consider the following S.D.E. with reflection: 

<7t - 90 + / b{qs)ds + m + *t (21) 

where <^t = /q v{qs)d\^\s,v{s) G N{qs) and : qt G D}) = 0. It is known 

that (|2T|) has a unique weak solution ((7,$) ( IJ. 

Theorem 4.7. The family {(f/^, <I'^)} converges in distribution to the unique 
solution {q, $) of ^21\) . 

Proof. By Theorem 4.6. we have that the flve-tuple {(g^, iJ^, X^, W)} 
is relatively compact in D(R+,]R^'"). Hence it (or a subsequence) converges in 
distribution to a stochastic process {{q,^, H, X,W)}. By the Skorohod rep- 
resentation theorem, one can find a probability space (fi, F, P) and realiza- 
tions {{q^',^^',H^',W'')} and {{q,'^, H, X ,W)} of {(g^, ff'', X^, T^)} and 
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{{q,^,H,X,W)} respectively such that {(g'", i/^, X^, VF'')} converges P- 
almost surely to {{q,^,H,X,W)}. Therefore by Theorem 3.2. (g, $) is a 
solution to the Skorohod problem for {D, N, H + X) P— almost surely. 
Now by the convergence of g'" to q we get that X must be given by: 

Xt= f b{qs)ds + Wt 
JO 

Finally Lemma 4.2 and its proof imply that Ht — go- 

□ 

We would like to note here that one could prove the convergence in distri- 
bution of the Langevin procces with reflection to the corresponding diffusion 
process with reflection using the Smoluchowski-Kramers approximation. How- 
ever the beauty and generality of the results of [3 resulted in using the method 
that was presented here. 
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